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Abstract — ^Adaptive control provides robustness and resili- 
ence for highly uncertain, and potentially unpredictable, flight 
dynamics characteristic. Some of the recent flight experiences of 
pilot-in-the-loop with an adaptive controller have exhibited un- 
predicted interactions. In retrospect, this is not surprising once it 
is realized that there are now two adaptive controllers interact- 
ing, the software adaptive control system and the pilot. An exper- 
iment was conducted to categorize these interactions on the pilot 
with an adaptive controller during control surface failures. One 
of the objectives of this experiment was to determine how the 
adaptation time of the controller affects pilots. The pitch and roll 
errors, and stick input increased for increasing adaptation time 
and during the segment when the adaptive controller was adapt- 
ing. Not surprisingly, altitude, cross track and angle deviations, 
and vertical velocity also increase during the failure and then 
slowly return to pre-failure levels. Subjects may change their 
behavior even as an adaptive controller is adapting with addi- 
tional stick inputs. Therefore, the adaptive controller should 
adapt as fast as possible to minimize flight track errors. This will 
minimize undesirable interactions between the pilot and the 
adaptive controller and maintain maneuvering precision. 

Keywords — adaptive controller; adaptation time; piloting effects 
I. Introduction 

Adaptive control in flight applications has a long and rich 
history dating back to the 1950s. Adaptive control provides 
robustness and resilience for highly uncertain, and potentially 
unpredictable, flight dynamics that characterize stall conditions 
or are due to damage on transport as well as high-performance 
aircraft. In the past decade, some flight experiences of pilots 
with an adaptive controller have exhibited unpredicted 
interactions [1, 2]. In retrospect, this is not surprising once it is 
realized that there are now two adaptive controllers interacting 
- the software adaptive control system and the pilot. The pilot 
is controlling the attitude and rates of the vehicle (definition of 
a control system), and the pilot’s method of controlling will 
change due to dynamically changing system parameters. One 
hypothesized reason for the adverse interactions with an 
adaptive controller in the loop is the pilot not realizing how the 
adaptive controller is changing aircraft dynamics. 

A. Previous Research 

As shown in [1] and [2], the pilot- adaptive controller inter- 
action may be unpredictable. It is unclear, though, what is 
causing these interactions assuming the adaptive flight control- 
ler is adapting in near real-time. In fact, others essentially 
found no differences in piloting capabilities and preferences 


using an adaptive controller except for low dynamic pressure 
flight phases where pilots rated the adaptive controller as better 
[3]. However, past data suggested that the “gain-changing logic 
can be fooled by . . . pilot control activity” [3]. 

More recent research is studying the efficacy of using adap- 
tive controllers to alleviate inappropriate pilot-control coupling 
caused by rate limiting and a pure time delay [4]. The delay 
margin of the pilot-vehicle system is estimated in the presence 
of rate limiting and time delay and an L\ adaptive controller is 
inserted to compensate and achieve the desired response of the 
system [5]. 

With these results in mind, this research set out to deter- 
mine the effect that the speed of the adapting controller would 
have on a pilot during a manual control task. The work would 
contribute toward characterizing the mechanisms by which 
these two adaptive controllers in the loop function and interact 
- one, a human and the other, a software control system. 

B. Experiment Objective 

An experiment was conducted to categorize the interaction 
on the pilot with an adaptive controller during control surface 
failures. The primary objective of the experiment was to 
determine how the adaptation time of the controller affects 
pilots. 

II. Method 

This experiment considered whether an adaptive controller 
helps pilots during control surface failures and how this con- 
troller affects pilots before, during, and after the control surface 
failures. The control surface failures were either a stuck surface 
or a slow uncommanded drift. The control surfaces failures 
were a combination of three control surfaces and these could 
be the left and right elevators symmetrically or asymmetrically, 
the left and right ailerons, and the upper and lower rudders. A 
human-in-the-loop experiment examined the effects of these 
control surface failures on pilot performance during a cruise 
flight phase while initiating a climb or descent at 500 feet per 
minute, or a heading change maneuver of less than 30 degrees. 
These maneuvers were indicated on the primary flight display 
(PFD) via the flight director and on the horizontal and vertical 
navigation map displays. 

A. Simulation Environment 

The physical setup of the simulator incorporated an out-the- 
window view in the upper center 30-inch diagonal screen and 
four 20-inch touchscreens below the out-the-window screen [6, 



7]. The middle -left touehsereen depleted the PFD and the 
middle -right touehsereen depleted an engine indieation display 
(EID). The far-right touehsereen displayed the after-run 
questions. Subjeets flew the aireraft with a right-handed 
joystiek. For a more detailed deseription of the experiment 
setup, see [6, 7], 

B. Independent Variables 

The independent variables were: 

1) Adaptation Time: Eaeh subjeet experieneed four 
eontroller adaptation times: zero seeonds, three seeonds, seven 
seeonds, and no adaptation (Never). These times indieated 
how long it took the adaptive eontroller to eompensate for the 
failures and return the elosed-loop aireraft dynamie response 
baek to the desired state. Zero seeonds indieated the fastest 
possible adaptation time, essentially the proeessor speed. 
Three seeonds was ehosen beeause with this time, the subjeet 
might notiee the eontroller adapting. As for seven seeonds, 
this was ehosen beeause the subjeet should notiee the 
eontroller adapting. 

2) Segment: Eaeh seenario was broken down into 
segments for data analyses. “Before failure” indieates the time 
before a failure oeeurred. “During failure” was while the 
adaptive eontroller was adapting. When the adaptive eontroller 
adapted immediately, there is no “during failure” segment. 
“After failure” was the time after the adaptive eontroller fully 
adapted to eompensate for the failure. When the adaptive 
eontroller loop was open - baseline eontroller only - and 
never adapted, there was no “after failure” segment. 

3) Subjects: The seventeen subjeets were an average of 
48±10 years old with the youngest 29 years old and the oldest 
61 years old. All of them were airline transport-rated pilots 
with an average of 26±1 1 years of flight experienee (minimum 
flight experienee was 7 years and the maximum 45 years) and 
an average of 10,706±7164 hours of flight experienee 
(minimum flight hours were 2,100 and the maximum 23,400). 

C. Dependent Variables 

The primary dependent variables involved flight teehnieal 
data. In partieular in the lateral axis was: eross traek error, the 
differenee between eurrent aireraft position and eommanded 
position; roll; and roll error, the differenee between eurrent 
bank angle and eommanded bank angle. In the longitudinal 
axis was: altitude error, the differenee between eurrent aireraft 
altitude and eommanded altitude; piteh; vertieal veloeity; and 
piteh error, the differenee between eurrent aireraft piteh angle 
and eommanded piteh angle. Also reeorded was lateral and 
longitudinal stiek input, and the veloeity and aeeeleration of 
these stiek inputs. 

Two other seeondary dependent variables involved 
subjeetive ratings by the partieipant. After eaeh run, subjeets 
provided a Cooper-Harper (CH) handling qualities rating 
(HQR) [8-10]. After eertain mns, subjeets also gave a NASA- 
Task Load Index (TLX) workload rating [6, 11]. 

D. Procedure 

During eaeh run, flight teehnieal data were reeorded. After 
eaeh run, subjeets gave a CH rating and after eertain runs, a 
NASA-TLX workload rating. After all the data runs were 


eompleted, subjeets fdled out a final questionnaire asking them 
about their preferenees on the information in the displays and 
displays themselves. 

Iff. Results 

A. Piloting Changes in the Longitudinal Axis 

When looking at subjeets’ longitudinal stiek input versus 
time, any effeets of how the adaptive eontroller internets with 
the input are masked (Fig. 1). For example, it is unelear wheth- 
er the adaptation time affeeted the magnitude of the longitudi- 
nal stiek input during or after the failure beeause of the seem- 
ingly random longitudinal stiek input and the amount of longi- 
tudinal stiek inputs needed to maintain desired piteh eommand 
involved many fine movements every few seeonds. However, 
when looking at the average piteh error (differenee between the 
aetual and eommanded piteh) for the data mns, this inereased 
with adaptation time {F(3, 2913)^3.164; p=0.01) and “during 
failure” {F(2, 29J 3)=92.031; p<0.001) before deereasing baek 
down to “before failure” levels after the failure (Table I). This 
is also refleeted in the average normalized longitudinal stiek 
input for the data mns (F{4. 2913)^115; p<0.001) (Fig. 2). 
Henee, subjeets’ longitudinal stiek input and the assoeiated 
piteh error inereases while the failure oeeurs and before the 
adaptive eontroller fully adapts but they settle to pre-failure 
levels after the adaptive eontroller finishes adapting. 



Fig. 1. Example Subject Normalized Longtitudinal Stick Input During a Data 
Run 


TABLE I. Average Pitch Error for the Data Runs by 
Adaptation Time and by Segment 


Adaptation Time 

Pitch Error 

SE“ of the 

(seconds) 

(degrees) 

Mean 

0 

1.24 

0.018 

3 

1.27 

0.022 

7 

1.30 

0.022 

Never 

1.46 

0.033 

Segment 


Before Failure 

1.28 

0.017 

During Failure 

1.55 

0.029 

After Failure 

1.12 

0.013 


SE = Standard Error 
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Fig. 2. Average Normalized Longitudinal Stick Input for the Data Runs by 
Adaptation Time and Segment 


TABLE II. Average Longitudinal Stick Acceleration for the 
Data Runs by Segment 


Segment 

Longitudinal Stick 
Acceleration 

SE of the 
Mean 

Before Failure 

4.12 

0.104 

During Failure 

3.18 

0.083 

After Failure 

2.58 

0.077 


The average altitude deviation from commanded (F(4, 
293)^157; p<0.001) and the average vehicle’s vertical velocity 
(F(4, 2913)=76; p<0.001) for the data mns also increased 
during the failure (Fig. 4); however, these values also increased 
after the adaptive controller fully adapted. This is true even for 
the 0-second adaptation time. A possible explanation for this is, 
given more time, the altitude deviation and vertical velocity 
would settle closer to “before failure” levels either due to learn- 
ing effects or the fact that the longitudinal stick velocity and 
acceleration decrease “after failure” indicating that subjects 
were more closely aligned with the flight director. The second 
interpretation is supported by the values for these parameters 
during the final 20 seconds of the data mn (Fig. 5). 


On the other hand, the average longitudinal stick velocity 
{F(4, 2913M.7(,- p^O.OOl) (Fig. 3) and acceleration {F(2, 
29 13)^1 A', p<0.001) (Table II) for the data runs slowly 
decrease with time. This effect may be more of a learning 
effect in that throughout the data mn, subjects learned to better 
control the vehicle. Consequently, if the failure occurred later 
in the mn, the pitch error “before failure” values may more 
closely mimic the pitch error “after failure” values. Two 
observations support this. The average longitudinal stick 
velocity for the data mns when the system never adapted is less 
than the average longitudinal stick velocity for the other 
adaptation times (Fig. 3). And, the longitudinal stick 
acceleration also decreased during the data mn (Table II). In 
addition, while longitudinal stick velocity increased during the 
adaptation time but both longitudinal stick velocity and accel- 
eration eventually settle to at or below pre-failure levels after 
the adaptive controller fully adapted. 
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Fig. 3. Average Longitudinal Stick Velocity for the Data Runs by Adaptation 
Time and Segment 



Adaptation Time (seconds) 

Fig. 4. Average Altitude Deviation for the Data Runs by Adaptation Time 
and Segment 
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Fig. 5. Average Vertical Velocity for the Data Runs by Adaptation Time and 
Segment 


B. Piloting Changes in the Lateral Axis 

Similar patterns emerged for the lateral axis as there were 
for the longitudinal axis. As before, inspecting the lateral stick 
input against time does not immediately indicate any changes 
in subject input behavior due to the failure (Fig. 6). Once again, 
it is unclear whether the adaptation time affected the magnitude 
of the lateral stick input during or after the failure because of 
the seemingly random lateral stick input and the amount of 
lateral stick inputs needed to maintain desired roll command 
involved many fine movements every few seconds. Flowever, 
the average roll error (the difference between commanded and 
actual roll) for the data mns generally increased “during fail- 
ure” but decreased “after failure” {F(4, 2913)^29; p<0.001) 
(Fig. 7). This same pattern is reflected in the average normal- 
ized lateral stick input for the data mns (F(4, 2913)=99; 
p<0.001) (Fig. 8). As with longitudinal stick, subjects’ lateral 
stick input and the associated roll error increased while the 
failure occurs and before the adaptive controller fully adapted 
but they generally settle to pre-failure levels after the adaptive 
controller fully adapted. The average lateral stick input velocity 
{F(4, 2913)=24; p<0.001) (Fig. 9) and acceleration {F(4, 
297ij=4.756; p=0.001) (Fig. 10) for the data mns also demon- 
strate this same pattern where the velocity and acceleration 
typically return to “before failure” values after the adaptive 
controller has fully adapted indicating nominal piloting tech- 
niques. 



Fig. 6. Example Subject Normalized Lateral Stick Input 
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Fig. 7. Average Roll Error for the Data Runs by Adaptaion Time and 
Segment 
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Fig. 8. Average Normalized Lateral Stick Input for the Data Runs by 
Adaptation Time and Segment 
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Fig. 9. Average Lateral Stick Input Velocity for the Data Runs by Adptation 
Time and Segment 
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Fig. 10. Average Lateral Stick Input Acceleration for the Data Runs by 
Adptation Time and Segment 


As with altitude deviation and vertieal velocity, the average 
cross track error {F(4, 293)=33', p<0.001) (Fig. 11) and bank 
angle error (F(4, 2913)^51', p<0.001) for the data runs in- 
creased during the failure (Fig. 12); however, these errors also 
increased after the adaptive controller fully adapted. This is 
true even for the 0-second adaptation time. As with the longi- 
tudinal axis, this may indicate that the vehicle dynamics felt the 
same to the subject but the vehicle was not exactly responding 
the same as it was “before failure” or potentially given more 
time, these errors would settle closer to “before failure” levels. 
The latter may be the case when looking at the values for these 
parameters during the final 20 seconds of the data mn (Fig. 1 1 
and Fig. 12). Flence, cross track error and bank angle error 
increased during the adaptation time but appear to eventually 
settle to pre-failure levels after the adaptive controller fully 
adapts. 
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Fig. 11. Average Cross Track Error for the Data Runs by Adaptation Time 
and Segment 


C. Subjective Ratings 

Adaptation time was significant for several of the NASA- 
TLX workload measures; in particular for mental demand 
(F(3, 764)=3.62, p=0.013), temporal demand {F(3, 764)^^. 55, 



p=0.004), perfonuance {F(3, 764)^4.55, p=0.004), effort 
{F(3, 764)^5.30, p<0.01), and overall workload 

(F(3J64)=5.29, p<0.01) (Table III and Fig. 13). As indicated 
in Table III, all measurements on the NASA-TLX had the 
same pattern with no adaptation having a higher workload than 
the other three adaptation times. This suggests that the adaptive 
controller did decrease the workload of the subject during 
control surface failures. The lower workload with the adaptive 
controller is also supported by the longitudinal and lateral stick 
inputs (Fig. 2 and Fig. 8, respectively) of subjects where more 
gross movements are present when there is no adaptive control- 
ler. 


TABLE III. Mean Workload by Adaptation Time 


Workload 

Measure 

Mean Value for Adaptation Time: 

0 seconds 

3 seconds 

7 seconds 

Never 

Mental Demand*'’ 

19.85' 

22.32 

22.38 

33.10 

Physical Demand 

20.84 

22.70 

20.35 

35.39 

Temporal Demand* 

20.16 

23.36 

22.20 

34.34 

Performance* 

1-ilF 

26.05 

22.81 

35.06 

Effort* 

25.94 

29.65 

26.39 

42.90 

Fmstration 

19.81 

22.43 

21.02 

31.03 

Overall Workload* 

21.64 

24.42 

22.52 

35.29 


* indicates statistical significance 
0=low demand, effort, frustration, or overall workload and 
100=high demand, effort, frustration, or overall workload 

0=good performance and 100=bad performance 



Adaptation Time (seconds) 
Fig. 13. NASA-TLX Ratings by Adaptation Time 


Adaptation time was also significant for the CFI rating 
(T?(3)=80.53, p<0.01). The FIQRs generally improved with the 
adaptive controller adaptation time (Fig. 14 and Fig. 15). As 
seen in the data above, having no adaptive controller increases 
workload (Table III and Fig. 13) and increases pitch and roll 
error (Table I and Fig. 7 respectively) which is reflected in the 
higher {i.e., worse) FIQRs. Conversely, the adaptive controller 
improved FIQRs especially in the case of 0 sec adaption time, 
where the vast majority of ratings were between FIQRs 1 and 3 
(Level 1 handling qualities). 

IV. Conclusions 


Adaptation Time (seconds) 

Fig. 12. Average Bank Angle Error for the Data Runs by Adaptation Time 
and Segment 


Adaptive control provides robustness and resilience for 
highly uncertain, and potentially unpredictable, flight dynamics 
that characterize stall conditions or are due to damage on 


transport as well as high-performance aircraft. But with an 
adaptive controller and a pilot, there are now two adaptive 
systems interacting. The pilot is controlling the attitude and 
rates of the vehicle (definition of a control system), and the 
pilot’s method of control will change due to dynamically 
changing system. 
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Fig. 14. Count of Cooper-Ftarper Ratings by Adaptation Time 
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Fig. 15. Cooper-Harper Rating Box Plot by Adaptation Time 

parameters. This experiment looked at how the adaptation time 
of the controller affects piloting inputs. 

The pitch and roll errors increased for increasing adaptation 
time and during the segment when the adaptive controller was 
adapting. This is also reflected in the stick input displacement 
with stick input approaching pre-failure levels after the adap- 
tive controller finishes adapting. However, stick velocity and 
acceleration slowly decrease with time. This may be more of a 
learning effect in that throughout the data run, subjects learned 
to better control the vehicle; however, if the failure occurred 
later in the run, the “before failure” values may more closely 
mimic the “after failure” values. Not surprisingly, altitude. 


cross track and angle deviations, and vertical velocity also 
increases “during failure”; however, these values also increase 
after the adaptive controller fully adapts. Given more time, 
these deviations and vertical velocity would settle closer to 
“before failure” levels. 

Moreover, subjects may change their behavior while an 
adaptive controller is adapting with additional stick inputs. 
These additional stick inputs result in larger flight track errors 
that do eventually approach pre-failure levels given enough 
time. Hence, the adaptive controller should adapt as fast as 
possible in order to minimize flight track errors, workload, and 
to maintain handling qualities. This will minimize undesirable 
interactions between the pilot and the adaptive controller and 
maintain maneuvering precision. 
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